18044-3 



WHAT IS CLAIMED IS: 




A method for selecting and modifying the shape of eyeglasses 
ystem, said method comprising the steps pf: 
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receiving at least one image of a person's face and storing the received 
image in an image database; 

displaying the stored image to a user; 

displaying to the user a plurality of styles of glass-frames available 
through the system; 

receiving a style selection by thefuser; 

receiving the position of the center of the pupils in the image; 



determining the axis of symmetry of the person's face and an 
approximate contour of the face as an elliptical two-dimensional template; 

determining a proper size of the selected frame; and 

/ 

generating a virtual image ofi the person wearing the selected frame by 
superimposing the image of the glass-framelto the image of the face. 

2. A method in accordance with Claim 1 wherein said step of 
determining a proper size of the selected frame comprises the step of utilizing a two- 
dimensional template to determine a posimon of eyes on the displayed image. 

3. A method in accordance with Claim 1 further comprising the 
step of refining the position of the cent^* of the pupils to subpixel precision utilizing 
template matching. 

4. A method in accordance with Claim 1 further comprising the 
step of determining the position of feat ires on the person's face 

5. A method in accordance with Claim 1 further comprising the 
step of receiving a frontal image of the person's face and storing the frontal image in a 
database. 
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6. A method in accordance witn Claim 1 wherein the system 
includes a server connected to at least one user devicje, said method further comprising 
the step of accessing the server via the user device. < 

7. A method in accordance with Claim 6 wherein the server is 
connected to the user device via a network. 

8. A method in accordance/with Claim 7 wherein the network is 
one of the Internet, an intranet, and a wide area'network. 

9. A method in accordance with Claim 1 wherein said step of 
receiving at least one image comprises the stjep of receiving two or more images of the 
person's face simultaneously obtained frpm two or more cameras oriented in a 
particular configuration. 



steps of: 



and 



10. A method in accordance with Claim 9 further comprising the 
estimating the epipolar geometry of the configuration of the cameras; 

generating a three-dimensional model of the person's face. 

11. A method in accordance with Claim 10 further comprising the 



steps of: 



determining pixel correspondence along scan-lines using normalized 
correlation with sub-pixel interpolation; 



determining the depth corresponding to each pixel utilizing 
triangulation; and 

generating a three-dimensional mesh of the position of the pixels. 

n accordance with Claim 1 1 further comprising the 



12. A method 
steps of: 

fitting a three-dh 
dimensional mesh; 



ensional template of a face to the generated three- 



generating an image of the three-dimensional model of the face; and 
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superimposing the glass-frame model to the person's face model to 
generate a virtual image of the person's face wearing the glass-frames. 

13. A method in accordance with Qlaim 1 further comprising: 

representing the shape of the lens using a parameterized curve or a 
piecewise linear curve wherein the shape depend/ upon the position of a number of 
control points; 

representing the shape of the lens and the front rim using a constrained 
parameterized curve, wherein the lens shape depends upon the position of the control 
points; and 

constraining the position of the control points to maintain the perimeter 
of the rim approximately constant and to maintain the tangent at the hinge and bridge, 
and the maximum curvature below a presc/ibed bound determined by the properties of 
the frame. 

14. A method in accordance with Claim 13 further comprising the 
step of modifying the selected glass-frame style by^changing the position of the 
control points while maintaining the pdrimeter approximately constant. 

15. A method in a^ordance with Claim 13 further comprising the 

steps of: 

maintaining the tangents of the selected glass-frames at the hinges and 
bridge constant; and 

modifying a selected style to have a prescribed perimeter, while 
minimizing the distortion from tip style selected by the user. 

16. A methocy in accordance with Claim 1 further comprising the 

steps of: 

associating a position of a set of control points to a set of perceptual 
qualities stored in a database; ^id 

modifying the ^iape of the lens based upon perceptual qualities. 
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17. A method in accordance with CJaim 16 wherein said step of 
modifying the shape of the lens comprises the step of jnodifying the shape of the lens 
based upon perceptual qualities chosen by the user. 



18. A method in accordance with Claim 17 further comprising the 



steps of: 



storing selected designs; 

comparing the stored designs; 

performing collaborative filtering; and 

recommending to the user shapes and styles according to selections of 
other customers that best match the choices <rf the current customer. 




19. A method in accordance with Claim 1 further comprising the 
step of controUing a lens grinding machine in accordance wi,h data received by the 

system. // 

20. A method in accordance with Claim 1 wherein the system 
includes a database of maps between thC geometry of the glass-frame, represented by 
the position of a number of control points, and the perceptual quality of the shape, 
said method further comprising the steps of: 

modifying the selected shape by specifying the amount of each 
descriptive quality; 

adapting the databasl to particular clientele; and 

performing collaborative filtering to suggest shapes and a style that 
matches the choices of other customers with potentially similar preferences. 

21. A method in accordance with Claim 20 wherein the database is 
one of a learning database utilizing psychophysical experiments and empirically 
established database. 

22. A method in accordance with Claim 1 further comprising the 
step of modifying the selected style and shape of the frame while satisfying 
constraints due to manufacturing process and inventory. 
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23. A method in accordance with jblaim 22 further comprising the 

steps of: 

evaluating the constraints within which any given frame can be 

modified; and 

enforcing the constraints during frame modification. 



24. A method in accordance with Claim 1 further comprising the 
step of receiving prescription data for the lenses. 

25. A method in accordancejwith Claim 1 further comprising the 
step of transmitting shape and style data to a] manufacturer who ships the selected 
eyeglasses directly to the customer. 

steps of: 



26. A method in accordance with Claim 1 further comprising the 



/ 

selecting landmark points of the person's face; 



head; and 



line. 



tracking the selected points through time as the person moves their 

/ 

estimating the three-dimensional motion of the landmark points on- 

// 



I 

27. A method in accordance with Claim 1 further comprising the 
step of generating a two and a half dimensional model. 

28. A method in accordance with Claim 27 further comprising the 
step of selecting a feature template for relevant facial features. 

29. A method in accordance with Claim 28 further comprising the 

steps of: 

tracking the position/bf the feature templates from frame to frame; and 
selecting a reference! frame. 

30. A method fn accordance with Claim 29 wherein said step of 
selecting a reference frame comprises the steps of: 
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selecting a reference frame from o^e of a 2-D Euclidean, 2-D Affine, 
2-D Projective, and 3-D Euclidean; and 

estimating a transformation. 

31. A method in accordance with Claim 30 further comprising the 
step of using the estimated transformation/to modify the appearance of a glass-frame 
template. 

32. A method in accordance with Claim 1 further comprising the 
step of creating a virtual image of the person's face moving and wearing the frames. 

33. A system for selecting and modify jjng the shape of eyeglasses, 
said system comprising: 

a device; and 

a server connected to the device and configured to receive information 
from a user via said device, said server further configured to: 

receive at least one image of a person's face and store the received 
image in an image database; 

display the stored image to the 

display to the user a plurality ^of styles of glass-frames available 
through the system; 

receive a style selection by the user; 

receive the position of the center of the pupils in the image; 



^r 



determine the axis of symmetry of the person's face and an 
approximate contour of the face as an elliptical two-dimensional template; 

determine a proper size oflthe selected frame; and 

generate a virtual image/of the person wearing the selected frame by 
superimposing the image of the glass-frame to the image of the face. 
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34. A system in accordance wi^ Claim 33 wherein said server 
further configured to utilize a two-dimensional tepiplate to determine a position of 
eyes on the displayed image. 

35. A system in accordance ^with Claim 33 wherein said server 
further configured to refine the position of tjfie center of the pupils to subpixel 
precision utilizing template matching. 

36. A system in accordance with Claim 33 wherein said server 
further configured to determine the position of features on the person's face. 



,/ 



37. A system in accordance with Claim 33 wherein said server 
further configured to receive a frontal image of the person's face and store the frontal 
image in a database. 



38. A system in ac^ 
connected to the device via a networ 



ice with Claim 33 wherein said server is 



39. A system ijn accordance with Claim 38 wherein the network is 
one of the Internet, an intranet, and^wia^areaj^fwork. 

40. A system in accordance with Claim 33 wherein said server 
further configured to receive two oJmore images of the person's face simultaneously 
obtained from two or more camerasforiented in a particular configuration. 

41. A method in accordance with Claim 40 wherein said server 
further configured to: 

estimate the epipofar geometry of the configuration of the cameras; and 

/ 

generate a three-dimensional model of the person's face. 

42. A systenf in accordance with Claim 41 wherein said server 
further configured to: 



determine pixe 



correspondence along scan-lines using normalized 



correlation with sub-pixel interpolation; 

determine the d^pth corresponding to each pixel utilizing triangulation; 

and 
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generate a three-dimensional me^B of the position of the pixels. 

43. A system in accordance/ with Claim 42 wherein said server 
further configured to: 

fit a three-dimensional template of a face to the generated three- 
dimensional mesh; 

generate an image of the three-dimensional model of the face; and 

superimpose the glass-frame model to the person's face model to 
generate a virtual image of the person's faie wearing the glass-frames. 

/ 

44. A system in accordance with Claim 33 wherein said server 
further configured to: 

represent the shape of? the lens using a parameterized curve or a 
piecewise linear curve wherein the shage depends upon the position of a number of 
control points; 

represent the shape ofjfne lens and the front rim using a constrained 
parameterized curve, wherein/the l^R^h^ upon the position of the control 

points; and 

constrain the position of the control points to maintain the perimeter of 
the rim approximately constant and to maintain the tangent at the hinge and bridge, 
and the maximum curvature beloy a prescribed bound determined by the properties of 
the frame. 

45. A system} in accordance with Claim 44 wherein said server 
further configured to modify the selected glass-frame style by changing the position of 
the control points while maintaining the perimeter approximately constant. 

/ 

46. A system in accordance with Claim 44 wherein said server 
further configured to: 

maintain the tangents of the selected glass-frames at the hinges and 
bridge constant; and 
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modify a selected style to have a prescribed perimeter, while 
minimizing the distortion from the style selected/by the user. 

47. A system in accordance with Claim 33 wherein said server 
further configured to: 

associate a position of a set $f control points to a set of perceptual 
qualities stored in a database; and 

modify the shape of the lens leased upon the stored perceptual qualities. 



48. A system in accordance with Claim 47 wherein said server 
^ further configured to modify the shape of the lens based upon perceptual qualities 

\Q 1 0 chosen by the user. 

i 

^ 49. A system in accor&ance with Claim 48 wherein said server 

ry further configured to: 

H 

'J store selected designs; 

5 

compare the storec^ 

Q 

y 1 5 perform collabor&r^filferHTg; and 

a I If 

^ II 
jsja // 

^ recommend to the user// shapes and styles according to selections of 

other customers that best match the choices of the current customer. 

i 

50. A system in accordance with Claim 33 wherein said server 
further configured to control a lens grinding machine in accordance with data received 




20 by the system. 

51. A system in accordance with Claim 33 wherein said system 

further comprises a database of maps between the geometry of the glass-frame, 

represented by the position of a n of control points, and the perceptual quality 

I 

of the shape, said server further configured to: 

I 

25 modify the selected shape by specifying the amount of each descriptive 

quality; 

adapt the database to particular clientele; and 
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perform collaborative filtering to suggest shapes and a style that 
matches the choices of other customers with potenually similar preferences. 

52. A system in accordance with Claim 51 wherein said database 
comprises one of a learning database utilizing/psychophysical experiments and an 
empirically established database. 

53. A system in accordance with Claim 33 wherein said server 
further configured to modify the selected style and shape of the frame while satisfying 
constraints due to manufacturing process and inventory. 

54. A system in accordance with Claim 53 wherein said server 
further configured to: 

evaluate the constraints within which any given frame can be modified; 

and 

enforce the constraints during frame modification. 

55. A system in ^ccordanpe with Claim 33 wherein said server 
further configured to receive pres^lptionMafa for the lenses. 

56. A system W-^ccOTda5ice with Claim 33 wherein said server 

further configured to transmit shape anli style data to a manufacturer who ships the 

\ 

selected eyeglasses directly to the customer. 



ome 



57. A system in accordance with Claim 33 wherein said server 
further configured to: / 

/ 

select landmark points /of the person's face; 

track the selected points through time as the person moves their head; 



and 



/ 



estimate the three-dimensional motion of the landmark points on-line. 



58. A system inl accordance with Claim 33 wherein said server 
further configured to generate a two and a half dimensional model. 

59. A system in accordance with Claim 58 wherein said server 
further configured to select a feature template for relevant facial features. 



ture tempiat* 
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60. A system in accordancqf with Claim 59 wherein said server 
further configured to: 

track the position of the feature templates from frame to frame; and 

select a reference frame. 

61. A system in accordance with Claim 60 wherein said server 
further configured to: 

select a reference frarp^frojp one of a 2-D Euclidean, 2-D Affine, 2-D 
Projective, and 3-D Euclidean; 

estimate a transformation" 

62. A system in /accordance with Claim 61 wherein said server 
further configured to use the estimated transformation to modify the appearance of a 
glass-frame template. 

63. A system In accordance with Claim 33 wherein said server 
further configured to create a victual image of the person's face moving and wearing 
the frames. 
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